Fluctuation-dissipation relations for complex networks 
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In the paper, we study fluctuations over several ensembles of maximum-entropy random networks. 
We derive several fluctuation-dissipation relations characterizing susceptibilities of different networks 
to changes in external fields. In the case of networks with a given degree sequence, we argue that the 
scale-free topologies of real-world networks may arise as a result of self-organization of real systems 
into sparse structures with low susceptibility to random external perturbations. We also show 
that the ensembles of networks with noninteracting links (both uncorrelated and with two-point 
correlations) are equivalent to random networks with hidden variables. 
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I. INTRODUCTION 

Recently, the statistical properties of real networks (in- 
cluding biological, social and technological systems) have 
attracted a large amount of attention among physicists 
(see e.g. 0, UQ)- It has been realized that despite 
functional diversity, most of real web-like systems share 
important structural features e.g. small average path 
length, high clustering and scale-free degree distribution. 
A number of network models have been proposed to em- 
body the fundamental characteristics. The models can 
be roughly divided into two classes: static (homogeneous, 
equilibrium) and evolving (causal, nonequilibrium) . The 
second class of causal networks encompasses, in partic- 
ular, the famous BA model Q, whereas configuration 
model 0, IE an d the large group of networks with hid- 
den variables H, 0, 0] belong to the first class of static 
networks. Although very intuitive, the mentioned rep- 
resentatives of static random networks are not properly 
defined from the point of view of the equilibrium statis- 
tical mechanics. Below we briefly outline what the men- 
tioned lack of seemliness means with reference to random 
networks. 

To start with, let us concentrate on the phrase random 
network. What does it mean that a network is random? 
One possible answer is that there is a large amount of 
randomness in the process of network construction. It 
treats to all the examples of homogeneous and causal 
networks quoted in the previous paragraph. The an- 
swer however suffers a few disadvantages among which 
the most striking is the issue of quantification of the ran- 
domness. Another answer to the asked question could be 
that random network is a member of a statistical ensem- 
ble of networks and the probability of the occurrence of a 
given network in random sampling is proportional to its 
statistical weight. Without a doubt, the last treatment 
directly follows principles of the equilibrium statistical 
mechanics. 

At the moment, a simple example could be the config- 
uration model. In this model, the total number of nodes 
is fixed to N and degrees of all nodes I = 1, 2, . . . , N 
create a specific degree sequence {k{\. Until now, noth- 



ing has been said about connections between nodes. As 
a rule, random graphs with a given degree sequence are 
constructed in the following way: i. first, attach to each 
node i a number fej of stubs (ends of edges); ii. next, 
choose pairs of these stubs uniformly at random and join 
them together to make complete edges. For sure, such 
a procedure represents a large randomness justifying the 
phrase random networks. On the other hand, however, 
the second among the mentioned possible meanings of 
the phrase, treating the resulting networks as members of 
the ensemble of graphs with the desired degree sequence, 
seems to be more familiar to physicists. 

As a truth, the concepts of statistical mechanics (in- 
cluding statistical ensembles, partition functions, aver- 
ages over ensemble and so forth) has already been ap- 
plied to analysis of complex networks. Although, the ma- 
jority among the recently submitted articles still define 
network models through construction procedures, there 
has also been published several interesting papers on the 
genuine statistical mechanics of random networks (cf. 
EJElEQEEmHIIl |U). The general 
idea is similar to all the above mentioned papers. Sta- 
tistical ensemble of networks is defined by specifying a 
set of networks Q which one wants to study (e.g. simple 
graphs, digraphs, weighted graphs) and a rule that asso- 
ciates probability distribution P(G) with these networks 
G G Q. The differences between the quoted approaches 
consist in different weight assignment strategies. 

In this contribution we extend the information- 
theoretic approach to random networks that was very re- 
cently proposed by Park an d Newman 0] (see also 01 )• 



Information theory |2lLl22j provides a criterion for setting 
up probability distributions over a given ensemble on the 
basis of partial knowledge and leads to a type of statisti- 
cal inference. It is the least biased estimate possible on 
the given information i.e. it is maximally non-committal 
with regard to missing information. Since the procedure 
consists in entropy maximization under constraints im- 
posed by the physical conditions of the ensemble, it is 
also known as maximum-entropy estimate |23| . 

In this paper, following Park and Newman ^||, we use 
Shannon entropy in order to establish probability dis- 
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tribution over analyzed networks |2J|. Park and New- 
man have presented a few exact solutions (in the sense 
of weighted averages over ensembles) of specific network 
models including undirected networks with a given de- 
gree sequence and networks incorporating arbitrary but 
independent edge probabilities. Here, we analyze these 
exactly solved models from the point of view fluctua- 
tions over ensembles. We discuss several fluctuation- 
dissipation relations for the mentioned ensembles. We 
also show that the quoted maximum-entropy models are 
equivalent to random networks with hidden variables . 



II. GENERAL DEFINITIONS 

In this section we review the fundamentals of 
maximum-entropy random networks due to Park and 
Newman |l8). 

In order, to correctly define statistical ensemble of net- 
works one has to start with specifying a set of graphs 
Q which one wants to study. In the following, we re- 
strict ourselves to labelled simple graphs [2(j with a fixed 
number of nodes N. Let us remind that a simple graph 
has at most one link between any pair of vertices and it 
does not contain self-loops connecting vertices to them- 
selves. Note also that there exists one-to-one correspon- 
dence (isomorphism) between simple graphs and sym- 
metric matrices of size N with elements cx^ equal either 
or 1. 

Once the set Q of possible networks has been estab- 
lished, in the next step one has to decide what kind 
of constraints should be imposed on the ensemble. The 
choice may be, for example, encouraged by properties of 
real networks like high clustering, significant modularity 
or scale- free degree distribution. In fact, due to the men- 
tioned isomorphism between graphs and matrices only 
such ensembles can be exactly solved which constraints 
are simply expressed in terms of adjacency matrix. 

Now, suppose that one would like to establish probabil- 
ity distribution over Q in such a way that the expected 
values (i.e. averages over the ensemble) of several ob- 
servables {xi(G)}, i = 1, 2, . . . , r were respectively equal 
to {(xj)}. Due to maximum entropy principle the best 
choice for probability distribution P(G) is the one that 
maximizes the Shannon entropy 

S=-J2P(G)lnP(G), (1) 

G 

subject to the constraints 

( Xi ) =^2xi(G)P(G) (2) 

G 

for i — 1, 2, . . . , r, plus the normalization condition 

£P(G) = 1. (3) 

G 



The Langrangian for the above problem is given by the 
below expression 

c = - E p ( G ) ln p ( G ) p ^ ^ 

G G 
r 

+ 5>«z i > -Y,Xi(G)P(G)), (5) 

»=1 G 

where the multipliers a and &i are to be determined by 
@ and J3J. 

Differentiating C with respect to P(G) and then equat- 
ing the result to zero one obtains the desired probability 
distribution over the ensemble of graphs with given prop- 
erties © 

e -H(G) 

P(G) = — ^— , (6) 
where H(G) is the network Hamiltonian 

r 

H(G) = J2^i(G)> (7) 

i=l 

and Z represents the partition function (normalization 
constant) 

Z = J2^ H{G) =e a+1 - (8) 

G 

Finally, in order to complete the section devoted to 
general considerations it is useful to define the free energy 
of the ensemble 

if = - In Z. (9) 

The last quantity is of wide use in the rest of the paper. 

Now, let us examine the introduced formalism with 
a few examples. In the next section, we will analyze 
fluctuations over the below presented ensembles. 

A. Microcanonical ensemble of random networks 

At the beginning, let us study the equivalent of the 
microcanonical ensemble for maximum-entropy random 
networks. Maximizing Shannon entropy Q subject to 
only normalization condition J3J, i.e. omitting other con- 
straints J2J), one obtains the uniform distribution over all 
simple graphs of size N 

p (G) = ^ (10) 

where f2 = represents the total number of the con- 
sidered networks i.e. the total number of — I symmetric 
matrices of size N. The uniform distribution (|I0|) means 
that each graph in the ensemble have the same weight 
regardless of its properties. 
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Since all graphs in the ensemble are equiprobable one 
can simply argue that the probability of a graph having 
to links is given by 



P(m) = 



(2) 



(ii) 



and respectively 



(TO) 



(?) 

£ 

711— 



mP(m) = 



(12) 



Similarly, the probability of an arbitrary node to have k 
nearest neighbors equals P(k) = ( JV / 7 1 )/2 Ar_1 , and the 
average connectivity is (k) = (N — l)/2. 

In fact, the considered microcanonical ensemble of ran- 
dom networks is equivalent to the ensemble of classical 
random graphs with the connection probability p = 1/2. 
Ensembles of classical random graphs with an arbitrary 
linkage probability will be considered in the next subsec- 
tion. 



B. Classical random graphs 

Now, let us consider an ensemble of networks with 
an expected number of links (to) (as stressed before the 
ensemble is equivalent to random graphs introduced by 
Erdos-Renyi) . The Hamiltonian Q for this ensemble is 
given by 



H(G) = 9m(G), 



(13) 



where 9 represents a field or an inverse temperature 
whose value is fixed and depends only on (to). Park and 
Newman 0] have shown that the partition function (JSJ 
for the ensemble is equal to 

Z= (l + e- e )("), (14) 
and respectively the free energy © can be written as 



F 



InZ 



N 



ln(l 



')■ 



(15) 



Having probability distribution JBJ over the ensemble 
one can, for example, find the relation between the aver- 
age number of links (m) and 9 



OF 



(16) 



Now, since 9 is fixed one can reexpress the last formula 
in terms of the linkage probability p that is known from 
the theory of classical random graphs 



(to) 



N 



p, 



(17) 



where 



P = 



1 



(18) 



Finally, let us point out that in the limit of very small 
fields 9 — > (high temperatures) the ensemble of random 
networks with an expected number of links is equivalent 
to the microcanonical ensemble of random networks IjlOjl 
introduced in the previous subsection. 



C. Networks with a given degree sequence 

At the moment, suppose that one would like to deal 
with random networks with an expected degree sequence 

{(h)} for i= 1,2,..., TV. (19) 
In this case, the network Hamiltonian is given by 

N 



(20) 



where the multipliers 9i represent a kind of potential as- 
signed to each node and they only depend on the ex- 
pected degrees (ki) (see Eqs. and l|27|)'l. The parti- 
tion function for the considered ensemble can be written 
as [lj| 



no 

Kj 



-(Si+Sj) 



), 



and the free energy is 

F=-]Tln(l + e -^+^), 

i<j 



(21) 



(22) 



Performing weighted averages over the ensemble one 
can easily prove the below identities: the first one de- 
scribing the connection probability between two nodes i 
and j 



1 



Pij 



e (8i+e 3 ) + i> 



(23) 



and the second identity for the average connectivity of a 
node characterized by the local field 9i 



N 



<*><«.>-£-£ 1 



e (fli+%) + 1 



N 
J'=l 



(24) 



The both expressions show the reverse relation between 
the two parameters (i.e. (ki) and 9i) characterizing 
each node. The relation consist in the statement: small 
degrees correspond to large multipliers and vice versa, 
nodes with a large number of connections possess small 
multipliers. 
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Park and Newman |3 have pointed out that instead 
of studying networks with an expected degree sequence 
(I19JI one can deal with networks characterized by an ex- 
pected degree distribution P((fci)) . The authors have 
argued that one can produce any degree distribution by 
a judicious choice of the distribution of multipliers p(0i). 
In fact, due to l|24|l . p{0i) resulting in the desired P((fcj)) 
can be determined from the below expression 



p{0i) = P({ki)) 



d{ki 



de, 



(25) 



where (ki)(8i) is given by (|24|l . There are, however, a few 
subtleties related to the transition between the sequence 
{{kx),{k 2 ) ...,{k N )} and P((h)). First, the Eq. fity 
defines p{0i) as an implicit function which, except for a 
very few cases, can not be explicitly calculated. Second, 
performing such a transition one has to keep in mind that 
our phase space consists of labelled graphs in which every 
node i = 1,2, ... ,N has assigned its own multiplier 9i 
(i.e. is distinguishable). Using p(6i) makes an impression 
that the nodes lose their identities. In such a case, there 
exists a threat of widening the original phase space. 

To proceed further, let us consider sparse networks. In 
the case, connection probabilities 123(1 factorize 



Pij 



where 



(ki)(0i) 



(kj)(kj l 
(k)N 



(26) 



(27) 



As shown in 0, [^} such ensembles are equivalent to 
uncorrelated networks. The relation l|27l) between ex- 
pected degrees and its multipliers makes the ensembles 
very simple for both Monte Carlo simulations and ana- 
lytical treatment. In particular, the distribution of mul- 
tipliers H25fl corresponding to P((ki)) is simply 



P [9i) = {ki)P({ki)), 



(28) 



where (fcj) is given by l|27|) . 

There exist, however, some side effects of the approx- 
imation. First, since the connection probability p^ < 1, 
(|26|l , thus the assumption of sparse networks is only valid 
for networks with non-negative Lagrange multipliers (i.e. 
8i,8j > 0). The restriction causes failure of the ap- 
proach in the case of scale-free networks P(k) ~ fc -7 
with 2 < 7 < 3. To existence of hubs k max ~ iV 1 ^ 7-1 ) 
|28| , i.e. nodes with negative multipliers (see comment af- 
ter Eq. 1|24[) L spontaneously develop degree correlations 
[2iJ |33|. It was argued 0, I^H that one can omit 
the correlations by applying the so-called structural cut- 
off i.e. forcing the largest degree to scale as k max ~ vJV. 
At the moment, let us stress that the structural cutoff 
in uncorrelated networks naturally emerges form the Eq. 
when 9i -> 0. 



D. Networks with two-point correlations 

In order to study random networks with two-point cor- 
relations one may consider a class of Hamiltonians Q 
constructed on the basis of an expected linkage probabil- 
ity 



p(G) = ]Te^(G). 



(29) 



In the last expression <Jij{G) is an element of the adja- 
cency matrix representing the graph G and charac- 
terizes field coupled to the hypothetical link {i,j}. The 
partition function and the free energy for the ensemble 
are given by 



0, F = -X>(1 



')• (30) 



i<j 



i<j 



Comparing l|21|) and (|30|l one can see that the previous 
ensemble of networks with an expected degree sequence 
is a special case (for = di + 6j) of networks with 
arbitrary two-point correlations. Similarly to (|23() one 
can also find that 



Pij 



dF 



(31) 



III. FLUCTUATIONS AND RESPONSES 

In classical thermodynamics, fields interacting with a 
system have conjugate variables which represent the re- 
sponse of the system to perturbation of the corresponding 
field. For example, the response of a gas to a change in 
volume is a change in pressure. The pressure p is the 
conjugate variable to the volume V. Similarly, the mag- 
netization M of a magnet changes in response to the ap- 
plied field B. The mentioned relations are produced by 
terms in the Hamiltonian of the form YX, where Y is a 
field and X is the conjugate variable to which it couples. 
Note, that the above also holds for maximum-entropy 
random networks being the subject of the paper, where 
(see Eq. Q) 



H{G) = Y,9 iXi (G). 



(32) 



Taking advantage of ©-(|5J), expectation values (xi) 
of observables x\ can be calculated as first derivatives 
of the free energy with the appropriate field 6i (cf. 



{x i ) = Y J Xi{G)P{G) = Wi . 

G 



(33) 



Similarly, second derivatives of the free energy F give the 
mean square fluctuations of the variables 



d 2 F 



(34) 
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Now, inserting (|33|l into l|34|) one obtains a very impor- 
tant result 



X 



(0) 



(35) 



that is known as the fluctuation-dissipation theorem 
(FDT). The theorem states that fluctuations in an ob- 

(6) 

servable Xi are proportional to the susceptibility x\ °f 
the observable to its conjugate field Let us remind 
that the susceptibility x f ^ measures the strength of the 
response of xi to changes in 9i . In reality, due to practical 
purposes, it is often simpler to analyze the susceptibility 

that directly depends on 9i (|35J) 



Xi^ to other field 



<9(a 



39,, 



d(xj) d<j)j 



d<k u) 
d0i Xi ' 



(36) 



where dcf>i/d9i is the transitional derivative. 

Probably the best known example of the theorem l|35|) 
is the one arising from fluctuations of energy in the 
canonical ensemble 



(E 2 ) {Ef 



dE 
"d(3 



kT 2 Cv 



(37) 



where Cy — d(E)/dT is the heat capacity (or thermal 
susceptibility), whereas kT 2 — d(3/dT is the respective 
transitional derivative. Another example relates fluctua- 
tions in the magnetization to the magnetic susceptibility 



(M 2 ) - {Mf 



1 dM 1 



1 (B 



(3 dB (3 



(38) 



The fluctuation-dissipation theorems (|35|l - l|38|) are in- 
teresting for a number of reasons. First, they join both 
microscopic description (left-hand side) and macroscopic, 
properties (right-hand side) of the considered systems. 
Second, they relate the actual state (fluctuations) of the 
systems to their future behavior (response). Third, due 
to FDT phase transitions certified by singularities in sus- 
ceptibilities can also be reported by large scale fluctua- 
tions. 

Extending the idea of the susceptibility one can con- 
sider what happens with a variable Xi when one changes 
the value of a field 6j . To study the problem one can de- 
fine a generalized susceptibility x\j which is a measure 
of the response of (xi) to the variation of the field 9j 



d(xi 



(39) 



(6) 

Again, the susceptibility x\j is a second derivative of the 
free energy 



d 2 F 

d9~d9~ 



(XiXj) (Xi)(Xj). 



(40) 



The issue of generalized susceptibilities is of special in- 
terest in lattice systems <|32|) . where the variables Xi for 



i = 1, 2, . . . , r may represent to the same observable but 
measured in different spatial points. Then, susceptibility 

Xlj is just the two-point correlation function between 
sites i and j. 

In the following, we will concentrate on fluctuations 
over a few selected ensembles of random networks. 



A. Classical random graphs 

At the beginning, let us consider the ensemble of clas- 
sical random graphs. By definition, the average number 
of links (m) is fixed in the ensemble. As stressed at the 
beginning of the section, there exist, however, fluctua- 
tions around the average. In fact, the probability of a 
graph G with m links is given by 



P(G) 



,-8m{G) 



(41) 



The variance of the above distribution calculated from 
(|35|l is very similar to H37fl 



d(m) 

d9 
d(m) dp 

dp d9 



(42) 



= p{l- P )C n 



where C m = d(m) /dp = (^) is the link capacity in classi- 
cal random graphs. Note that for a given network size N 
the link capacity does not depend on the linkage prob- 
ability C m (p) = const (classical ideal gases reveal the 
analogous behavior CV(T) = const). 



B. Networks with a given degree sequence 

Now, let us continue with random networks character- 
ized by an expected degree sequence (|19|l . 

Taken advantage of (|23|) and (|24|l . fluctuation- 
dissipation relations l|35|) for the ensemble may be written 
in the following form 



m _ 



djkj 
' d9 t 



= (kf)-(h) 2 



(43) 



At the moment, before delving into the discussion of the 

(6) 

last expression, let us note that the susceptibility x\ is 
also given by the below formula 



djkj) dp i:) 
dp.u d9. t 



\ - dPij r 
no. 



dOi 



(44) 



where Cs. 



d(ki) j 'dpij represents the link capacity. 



Here, since CV,- = 1 the fluctuations in nodes degrees 
result only form the transitional derivative dp^ / d9i. 
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<k*>=1 



<k*>=7 



<k*>=N 



FIG. 1: Schematic representation of networks possessing 
N = 19 nodes with one nearest neighbor (k) = 1 and 
the supernode (the gray one) with the tunable connectivity 
(k*) = l,2,...,N. 



The importance of the two above identities lies in the 
fact that from the fluctuations over degrees of nodes char- 
acterized by the same local field 6i, one can deduce on 
the future behavior of the nodes in the face of possible 
changes in 0j. Large (small) fluctuations correspond to 

high (low) local susceptibility xf ■ 

Now, let us note, that in the case of small degrees 
(see also the assumption of sparse networks l|27J) ). the 
fluctuation-dissipation relation (|43|) gets a simplified 
form 



(^-(fc,) 2 ^), 



(45) 



indicating the Poissonian fluctuations. Since however, in 
the case of sparse homogeneous networks one can omit 
the last term in (|43|l . in sparse scale-free networks with 
the characteristic exponent 2 < 7 < 3, the mentioned 
term is dominated by hubs and the nodes susceptibili- 
ties x\ are much smaller than their expected degrees 
(ki). The total network susceptibility decreases making 
the system resistant against random changes in the land- 
scape of multipliers and simultaneously susceptible to be- 
havior of supernodes |H, 0| . 

In order to establish the better understanding of the 
statement included in the last paragraph, let us consider 
a trivial network consisting of N nodes with expected de- 
grees (k) = 1 and one supernode with the tunable desired 
degree (k*) = 1,2, ... ,N (in the sequel, the parameters 
denoted by the star apply to the supenode). Adjusting 
the degree of the supernode makes possible to smoothly 
pass between regular graphs (for (k*) — 1) and star net- 
works (for (k*) = N) (see Fig. QJ. The transition enables 
the understanding of what the reduced network suscep- 
tibility consists in. 

First, let us find the Lagrange multipliers 9 and 9* 
corresponding to the nodes of the considered ensemble. 
Taking advantage of (|24|l one can show, that the param- 
eters fulfill the set of equations 



1 



N - 1 



1 



-,2I) 



(*•> = 



V 



O0 + 0* 



Solving the above equations for 9 and 9* one gets (see 



e, e 
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X \\ 







10 
< k> 



100 



FIG. 2: (a) Lagrange multipliers 8 and 6* as a function of 
(k*), (b) relative susceptibilities \ and \* as a function of 
(k*). Here, we have assumed iV = 100. 
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Next, inserting the multipliers into 1|23|) and then tak- 
ing advantage of (|4^|l one obtains the susceptibilities of 
expected degrees due to changes in the nodes intensive 
parameters. The relative susceptibilities are respectively 
given by 



X = 



1 d(k) 



= 1 - 



(JV-(fc*)) 2 



N 2 (N-1) N 2 



for the bulk of nodes, and 

1 d(k* 



X' 



(k*) 89* 



N 



(46) 



(47) 



for the supernode. 

The behaviour of susceptibilities (|46|l and 147(1 is de- 
picted at the Fig. [2b- One can see that the suscepti- 
bilities decrease to when the expected degree of the 
hub (k*) approaches N. In the region of the vanishing 
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susceptibilities, the small changes in the fields 9 and 9* 
poorly affect the topological features (i.e. (k*)) of the 
considered networks (c.f. Fig. [5^). The last statement 
supports our previous claim of the resilience of such net- 
works against random external perturbations. The large 
(k*) makes that the supernode accumulates most of the 
links present in the system and causes that there exist rel- 
atively small number of network realizations which both: 
i. fulfill physical constraints of the ensemble and ii. pos- 
sess significant statistical weights. For example, only one 
such a realization exists in the limiting case of the star 
network with k* — N. 



IV. EQUIVALENCE OF MAXIMUM ENTROPY 
NETWORKS AND NETWORKS WITH HIDDEN 
VARIABLES 

In the section, we continue the thread of Poissonian 
fluctuations (J35JI. 

Random networks with hidden variables are simply de- 
fined through the construction procedure that consists of 
only two steps: 

i. first, prepare N nodes and assign them hidden 
variables independently drawn from the probability 
distribution R(h), 

ii. next, each pair of nodes {i,j} link with a probabil- 
ity Tij . 

One can show, that the uncorrelated networks with hid- 
den variables arise from the factorized connection prob- 
ability 



At the beginning, let us reformulate the probability of 
a graph G in the ensemble 



P(G) = 



,-H(G) 



(49) 



where H(G) and Z are respectively the graph Hamilto- 
nian H20|) and the partition function (|21|) . Taking ad- 
vantage of the connection probability (|23[) . P(G) can 
be written in a similar form as in the case of classical 
random graphs (|41|) 



i<3 



where 



(i- 



(50) 



(51) 



whereas are elements of the adjacency matrix describ- 
ing G and they are equal to either 1 or depending on 
whether i and j are connected or not. 

In the following, without the loss of generality, we will 
concentrate on the node i = 1. Having P(G) one can 
calculate the probability P({crij}) of the node to have a 
given linkage profile {<Jij} (e.g. {0,0,0,1,0,1,. . . ,0}) 



mm}) = E p ( G ) 



= n $ ( 1 ^') n e *(^') 

j 2<i<j ff i3 =0 



(52) 



hihj 



(48) 



whereas networks with two-point correlations require 
more sophisticated expressions for r,j . 

Even comparing the above short review to our previ- 
ous results on sparse networks with an expected degree 
sequence (cf. Eqs. ffify and P%|0 . allows one to deduce 
on the equivalence of the two approaches. In the course 
of the section, we will argue that the claimed equivalence 
also holds for networks with two-point correlations. We 
will prove it by recovering the so-called Poissonian prop- 
agators characterizing both correlated and uncorrelated 
sparse networks with hidden variables Q- 



A. Networks with a given degree sequence 

At the moment, it is clear that although the expected 
degree of the node i is (ki), but due to ensemble fluc- 
tuations its actual degree ki changes from network to 
network. Our aim is to find the so-called propagator 
P(ki/9i) i.e. the degree distribution of the node given 
that it is characterized by the multiplier 9i. 



where the first sum runs over all networks G* with the 
fixed sequence {cry} (i.e. the fixed neighborhood of the 
node i — 1). Now, in order to obtain P(ki/9{) one has to 
sum the probabilities (|52|) over different sequences {<Jij}* 
representing the same degree k\ = J2j a ij 



P(k 1 /9 1 )= E P (Wio})- 



(53) 



Up to this point, the derivation of P(ki/6\) has been 
exact. Now, before proceeding with approximations let 
us test the formula (|53l) against the simplest ensemble i.e. 
networks with an expected homogenous degree sequence. 
In the ensemble, all nodes have the same desired degree 
and also 9i = 9. It is easy to check that the degree 
distribution of an arbitrary node i|53() is given by 



P{k/9) 



N - 1 



/(I 



P) 



N-l-k 



(54) 



where the binomial factor in the front of the expres- 
sion arises from the fact that there exist (^jT 1 ) differ- 
ent connection profiles corresponding to degree k and 
p — ( e 2e + 1) _1 (|2"3|l (please do not confuse it with ||THJ|, 
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where 9 has a different meaning !). One should not be 
surprised with the last result. If it is not obvious, let us 
stress that the ensemble of networks with an expected 
homogeneous degree sequence is in fact equivalent to the 
ensemble of classical random graphs. To become familiar 
with the statement compare the formulas (|14(l and l|21|l . 

Now, in order to recover the claim of equivalence be- 
tween the considered maximum-entropy models and ran- 
dom networks with hidden variables one has to apply the 
mean field approximation to the expression (|53[l 



P{ki/6 X ) 



N - 1 
fci 



(JV-l-fci) 



(55) 



where (py) = EjPU /(**-!) = (kx)/(N-l) Q9- The 
assumption of sparse networks enables further simplifica- 
tion of the distribution 



p(h/e 1 



(fci 



fci! 



(56) 



recovering the result previously derived by Soderberg 
8] for uncorrelated networks with hidden variables. 
The Poissonian propagator (|56*j) indicates the mentioned 
equivalence of the considered maximum- entropy net- 
works and the well-known class of uncorrelated random 
networks with hidden variables (Lagrange multipliers 
characterizing nodes correspond to hidden attributes). 

As pointed out in |9(, the result is indeed very strong 
since it also holds for random networks with two-point 
degree correlations (see Eq. (|57|l and also Eq. (23) in 
0). The key point to notice with reference to the last 
expression is that in the region of small degrees, due to 
the Poissonian fluctuations (c.f. I|45|l and 1)56(1 ). the real 
degree distributions observed in single realizations of the 
considered networks strongly differ from the desired de- 
gree distribution P((fcj)). On the other hand, in the limit 
of large degrees the real distribution and the expected 
one converge. The interplay between the two distribu- 
tions has been carefully studied in our previous paper 

M. 



B. Networks with two-point correlations 

One can show that probability of a graph G in the 
ensemble l|29[l can be transformed into the same form 



(f 501) as the one for random networks with an expected 
degree sequence, where the linkage probability is given 
by 1131(1 . Performing the same calculations as in the case 
of ensembles analyzed in the previous subsection, one 
can prove that in the limit of sparse networks the degree 
distribution of a specific node is Poissonian l|56|l 



p(fci/{e M }) 



e -<fci>^ 1 )fe 1 



fci! 



(57) 



where (fci) = '^2 i Pu and pu represents the connec- 
tion probability given by (|31|) . Again, the last formula 
supports the claimed equivalence between the analyzed 
maximum-entropy networks with two-point correlations 
and the class of correlated networks with hidden variables 
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V. CONCLUSIONS 

In this paper we have extended the information- 
theoretic approach to random networks that was very re- 
cently proposed by Park and Newman 18] . We have con- 
centrated on fluctuations over ensembles of undirected 
networks with non-interacting edges, including random 
networks with a given degree sequence and networks 
characterized by two-point correlations. We have stud- 
ied a few fluctuation-dissipation relations characterizing 
susceptibilities of different networks to changes in the ex- 
ternal fields. In the case of networks with a given degree 
sequence, we have argued that the scale-free topologies of 
real networks may arise as a result of self-organization of 
real systems into sparse structures with the low suscepti- 
bility to random external perturbations. Finally, we have 
also shown that maximum-entropy networks are equiva- 
lent to random networks with hidden variables. 
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